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Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on March 06, 2006 has been entered. 



Response to Amendment 

2. The amendment filed on March 06, 2006 has been fully considered but are moot in view 
of the new grounds of rejection. 

• Claims 23 and 24 are cancelled. 

• Claims 1-22 are presented for examination. 

Claim Rejections - 35 USC § 103 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



3. 



Claims 1-8 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Sicola 
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(U.S. Patent Number 6,643,795, hereinafter "Sicola"') in view of Lim et al. (U.S. Patent Number, 
6526521, hereinafter "Lim"). Sicola shows substantial features of the claimed invention, 
including: 

A first host group: Sicola teaches an apparatus for sending a heartbeat signal in a cluster 
computing system (abstract, fig. 16), the apparatus comprising: 

Fig. 2 shows a first host group 218, host 101 ; a first 

storage system associated with the first host group (Fig. 2 shows a first storage system 203 
associated with the first host group 218 (host 101). 

the first host group coupled via a network to a second host group: (Fig.2 shows the first 
host group 218 coupled via a network to a second host group 219, 

The first storage system coupled via a remote link separate from the network to a second 
storage system associated with the second host group: (Fig.2 shows the first storage system 203 
coupled via a remote link 214 separate from the network to a second storage (213) system 
associated with the second host group (219). 

The first host group configured to selectively send a heartbeat signal by use of the remote 
link by sending a memory command to the first storage system which is mirrored via the remote 
link using a remote copy mechanism to the second storage system: "PPRC manager 515 is 
responsible for managing functions including initiating the connection and heartbeat with the 
remote controller and initiating the remote copy for incoming host writes (via host port initiator 
510)" (Sicola, col.9, lines 31-43 and col. 19, lines 20-49, wherein the second host group is 
configured to use the received heartbeat signal to determine whether a failover should be 
performed. 

However, Sicola does not show a second host group configured to use a received heartbeat signal 
to determine whether a failover should be performed. Nonetheless this feature is well known in 
the art and would have been an obvious modification to the system disclosed by Sicola. In 
analogous art, Lim discloses data storage pathways that connect a cluster of nodes to a data 
storage system in a manner that enables a failover operation to occur from a first node to a 
second node when the first node suffers pathway degradation. Lim shows "each cluster 
framework portion 28 communicates with other cluster framework portions 28 on other nodes 22 
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using intracluster communication signals 74 (e.g., heartbeat signals informing the other cluster 
framework portions 28 of that cluster framework portion's existence and status... In particular, 
the cluster framework 28 can detect the loss of a particular resource and signal applications that 
are dependent on the lost resource in order to trigger certain fault-tolerant operations. For 
example, if the cluster framework 28 detects the loss of the pathway set 24 for a particular node 
22, the cluster framework 28 can perform a failover operation for an application that depended 
on the lost pathway set 24" (col. 8, lines 28-64. See also col. 17, lines 42-64). Given these 
teachings, a person of ordinary skill in the art would have readily recognized the desirability and 
advantages of modifying the system of Sicola so as to use the failover operation system of Lim, 
in order to manage services (or resources) in the cluster to prevent failures from affecting 
computer system performance and such that the cluster as a whole will remain operational. 

4. Claims 1-8 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ofek 
(U.S. Patent Number 6,044,444, hereinafter "Ofek" 5 ) in view of Sicola et aL (U.S. Patent 
Number, 6,643,795, hereinafter "Sicola") and further in view of Lim U.S Patent number, 
6,526,521. Ofek shows substantial features of the claimed invention, including: 

A first host group: Ofek, Fig.4 shows a first host group 212. 
A first storage system associated with the first host group: Ofek, Fig.4 shows a first storage 
system 214 associated with the first host group 212. 

The first host group coupled via a network to a second host group: Ofek, Fig.4 shows the 
first host group 212 coupled via a network to a second host group 252 

The first storage system coupled via a remote link separate from the network to a second 
storage system associated with the second host group: Ofek, Fig.4 shows the first storage system 
214 coupled via a remote link 241 separate from the network to a second storage system 
associated with the second host group. 

The first host group configured to selectively send signals by use of the remote link by 
sending a memory command to the first storage system which is mirrored via the remote link 
using a remote copy mechanism to the second storage system: "Accordingly, data may be 
transferred between the primary and secondary data storage system controllers synchronously, 
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when a primary host computer requests writing of data to a primary data storage device, or 
asynchronously with the primary host computer requesting the writing of data to the primary data 
storage system, in which case the remote data copying or mirroring is completely independent of 
and transparent to the host computer system." (Ofek, col. 2, lines 50-57). 

However, Ofek does not show sending a heartbeat signal. Nonetheless this feature is well 
known in the art and would have been an obvious modification to the system disclosed by Ofek. 
In analogous art, Sicola discloses controller-based bi-directional remote copy system with 
storage site failover capability. Sicola shows sending a heartbeat signal: "PPRC manager 515 is 
responsible for managing functions including initiating the connection and heartbeat with the 
remote controller and initiating the remote copy for incoming host writes (via host port initiator 
510) " (Sicola, col.9, lines 31-43) Given these teachings, a person of ordinary skill in the art 
would have readily recognized the desirability and advantages of modifying the system of Ofek 
so as to use a copy mechanism for the heartbeat, such as taught by Sicola, in order to check if the 
disks are operational. In addition, device failures are detected immediately and automatic node 
failover from a primary to a designated alternate node is performed in time. 

However, Sicola and Ofek do not show a second host group configured to use a received 
heartbeat signal to determine whether a failover should be performed. Nonetheless this feature is 
well known in the art and would have been an obvious modification to the system disclosed by 
Sicola and Ofek. In analogous art, Lim discloses data storage pathways that connect a cluster of 
nodes to a data storage system in a manner that enables a failover operation to occur from a first 
node to a second node when the first node suffers pathway degradation. Lim shows "each cluster 
framework portion 28 communicates with other cluster framework portions 28 on other nodes 22 
using intracluster communication signals 74 (e.g., heartbeat signals informing the other cluster 
framework portions 28 of that cluster framework portion's existence and status... In particular, 
the cluster framework 28 can detect the loss of a particular resource and signal applications that 
are dependent on the lost resource in order to trigger certain fault-tolerant operations. For 
example, if the cluster framework 28 detects the loss of the pathway set 24 for a particular node 
22, the cluster framework 28 can perform a failover operation for an application that depended 
on the lost pathway set 24" (col. 8, lines 28-64. See also col. 2, lines 19-29). Given these 
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teachings, a person of ordinary skill in the art would have readily recognized the desirability and 
advantages of modifying the system of Sicola and Ofek so as to use the failover operation system 
of Lim, in order to manage services (or resources) in the cluster to prevent failures from affecting 
computer system performance and such that the cluster as a whole will remain operational. 

5. Claims 9 and 11-22 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Carter (US Patent Number 6553401) in view of Sicola and further in view of Lim U.S Patent 
number, 6,526,521 . 

In referring to claims 9 and 11, Carter shows substantial features of the claimed invention, 
including: A production host group; A standby host group coupled to the production host group 
by a network: Figure 1 shows multiple host groups coupled by a network, elements 112 A and 
112B 

A remote mirror coupled between the production host group and the standby host group: 
"Another step of the method includes mirroring the shared volume to a second mass storage 
device of a second subcluster that is located at a second site and that includes at least one server 
in order to obtain a first mirrored copy of the shared volume at the second site. 11 Carter, col. 2, 
lines 22-27) 

The remote mirror including a production site heartbeat storage volume (heartbeat PVOQ 
and a standby site heartbeat storage volume (heartbeat SVOL) coupled by a remote link to the 
heartbeat PVOL: Figure 1, Storage volumes 108 A are connected to Storage volumes 108B are 
coupled through the network; 

The production host group configured to selectively send a heartbeat signal to the standby host 
group by use of the remote link: "In an exemplary embodiment, the cluster manager determines 
whether a server 1 16A, 1 16B, ... 1 16Z of the current subcluster 1 12A, 1 12B, ... 1 12Z is available 
based upon heartbeat signals transmitted amongst the servers 1 16 A, 1 16B, ... 1 16Z of the Server 
cluster 106. " Carter, col. 6, lines 34-39). 

The remote mirror being separate from the network: Carter, Fig.l shows the mirrors 108 A, 108B, 
108Z are separate from the network 1 14A, 1 14B, and 1 14Z 

However, Carter is silent as to how the heartbeat signal is sent. Nonetheless this feature is well 
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known in the art and would have been an obvious modification to the system disclosed by Carter 
as evidenced by Sicola. In analogous art, Sicola discloses controller-based bi-directional remote 
copy system with storage site failover capability. Sicola shows: "FW layer 520 is not aware of 
any PPRC manager 515 context (state change or transfer path). Host port target code 505 allows 
only host initiators to connect to the controller port which is a dedicated data replication port 
PPRC manager 5 1 5 is responsible for managing functions including initiating the connection and 
heartbeat with the remote controller and initiating the remote copy for incoming host writes (via 
host port initiator 510) " (Sicola, col. 9, lines 31-43) Given these teachings, a person of ordinary 
skill in the art would have readily recognized the desirability and. advantages of modifying the 
system of Carter so as to use a copy mechanism for the heartbeat, such as taught by Sicola, in 
order to check if the disks are operational. In addition, device failures are detected immediately 
and an automatic node failover from a primary to a designated alternate node is performed in 
time. 

However, Sicola and Carter do not show a standby host group operable to use a received 
heartbeat signal to determine whether a failover should be performed. Nonetheless this feature is 
well known in the art and would have been an obvious modification to the system disclosed by 
Sicola and Carter. In analogous art, Lim discloses data storage pathways that connect a cluster of 
nodes to a data storage system in a manner that enables a failover operation to occur from a first 
node to a second node when the first node suffers pathway degradation. Lim shows "each cluster 
framework portion 28 communicates with other cluster framework portions 28 on other nodes 22 
using intracluster communication signals 74 (e.g., heartbeat signals informing the other cluster 
framework portions 28 of that cluster framework portion's existence and status... In particular, 
the cluster framework 28 can detect the loss of a particular resource and signal applications that 
are dependent on the lost resource in order to trigger certain fault-tolerant operations. For 
example, if the cluster framework 28 detects the loss of the pathway set 24 for a particular node 
22, the cluster framework 28 can perform a failover operation for an application that depended 
on the lost pathway set 24" (col. 8, lines 28-64. See also col. 2, lines 19-29). Given these 
teachings, a person of ordinary skill in the art would have readily recognized the desirability and 
advantages of modifying the system of Sicola and Carter so as to use the failover operation 
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system of Lim, in order to manage services (or resources) in the cluster to prevent failures from 
affecting computer system performance and such that the cluster as a whole will remain 
operational. 

In referring to claim 12, Carter in view of Sicola discloses, 

A first heartbeat check module configured to generate the heartbeat signal: 

A module configured to generate a heartbeat signal is inherently implied in a system that 
sends said heartbeat signal. 

In referring to claim 13, Carter in view of Sicola discloses, 

A second heartbeat check module configured to receive the heartbeat signal: A module 
configured to receive a heartbeat signal is inherently implied in a system that receives said 
heartbeat signal 

In referring to claim 14, Carter in view of Sicola discloses, 

The standby host group manages operations of the cluster computing system if an invalid 
heartbeat signal is received by the standby host group from the production host group: The 
standby host group taking over operations if the production host group fails is inherently implied 
in a fail over system that utilizes a standby host group "Moreover, the computer readable 
medium includes instructions, which when executed, cause a cluster manager to determine to 
reallocate the service to a first Server of the second subcluster, allocate the first mirrored copy to 
the first server of the second subcluster, and allocate the service to the first server of the second 
subcluster in response to determining to reallocate the service to the first server of the second 
subcluster. " Carter, col. 3, lines 8-16). 

In referring to claim 15, Carter in view of Sicola discloses, 

A serial number assigned to the heartbeat message "a time indicator indicating a time of the 
generation of the heartbeat message; an identifier identifying a sender of the heartbeat message: 
Heartbeat messages (synonymous with "keepalive"' packets) have an identifier (IP address), the 
time of generation, and a serial number by definition 
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In referring to claim 16, Carter in view of Sicola discloses, * A second remote mirror coupled 
between the production host group and the standby host group : 

"The cluster manager is operable to allocate the service and the at least one volume of the first 
mass storage device to a first server of the first subcluster, and mirror the at least one volume of 
the first mass storage device to the at least one volume of the second mass storage device. " 
Carter, col. 2, lines 49-53) 

Mirroring "at least" one volume inherently implies the volume is an embodiment of the 
invention, mirroring of more than one 

The second remote mirror including a second remote link for transmitting a heartbeat signal: 
Figure 1, Storage volumes 108 A are connected to Storage volumes 108B are coupled though the 
network 

In referring to claim 17, Carter shows substantial features of the claimed invention, including: 
Generating a heartbeat signal from a production host group; selectively sending the heartbeat 
signal to the standby host group from the production host group by use of a remote link. Carter, 
col. 6, lines 34-39 (See full quote above) 

Enabling the standby host group to manage operations of the cluster computing system if an 
invalid heartbeat signal is received by the standby host group from the production host group: 
"Moreover, the cluster manager is operable to determine to reallocate the service to a first server 
of the second subcluster, allocate the at least one volume of the second mass storage device to a 
first server of the second subcluster, and allocate the service to the first server of the second 
subcluster in response to determining to reallocate the service to the first server of the second 
subcluster. " Carter, col. 2, lines 53-60) However, Carter is silent as to how the heartbeat signal is 
sent. Nonetheless this feature is well known in the art and would have been an obvious 
modification to the system disclosed by Carter as evidenced by Sicola. In analogous art, Sicola 
discloses controller-based bi-directional remote copy system with storage site failover capability. 
Sicola shows: "FW layer 520 is not aware of any PPRC manager 515 context (state change or 
transfer path). Host port target code 505 allows only host initiators to connect to the controller 
port which is a dedicated data replication port PPRC manager 515 is responsible for managing 
functions including initiating the connection and heartbeat with the remote controller and 
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initiating the remote copy for incoming host writes (via host port initiator 510) " (Sicola, col. 9, 
lines 31-43) Given these teachings, a person of ordinary skill in the art would have readily 
recognized the desirability and. advantages of modifying the system of Carter so as to use a copy 
mechanism for the heartbeat, such as taught by Sicola, in order to check if the disks are 
operational. In addition, device failures are detected immediately and an automatic node failover 
from a primary to a designated alternate node is performed in time. 

As to determining, by the standby host group, that a failure has occurred, if an invalid heartbeat 
signal is received by the standby host group from the production host group, See Lim above. Lim 
shows "each cluster framework portion 28 communicates with other cluster framework portions 
28 on other nodes 22 using intracluster communication signals 74 (e.g., heartbeat signals 
informing the other cluster framework portions 28 of that cluster framework portion's existence 
and status... In particular, the cluster framework 28 can detect the loss of a particular resource 
and signal applications that are dependent on the lost resource in order to trigger certain fault- 
tolerant operations. For example, if the cluster framework 28 detects the loss of the pathway set 
24 for a particular node 22, the cluster framework 28 can perform a failover operation for an 
application that depended on the lost pathway set 24" (col. 8, lines 28-64. See also col. 2, lines 
19-29). 

In refining to claim 1 8, Carter in view of Sicola shows, 

Selectively sending a heartbeat signal to the production host group from the standby host group 
by use of a second remote link: Carter. Col. 6, lines 34-39 (See full quote above) 

In referring to claim 19, Carter in view of Sicola shows registering a first storage volume to a 
device address entry, the first storage volume located in a production site, and, from the 
production site, changing a remote minor that includes the first storage volume into an enabled 
mode; sending an activation message from the production site to a standby site; registering a 
second storage volume to the device address entry, the second storage volume located in the 
standby site; from the standby site, changing the remote 1 mirror into an enabled mode to install a 
remote mirror formed by the first storage volume and second storage volume: "Pursuant to 
another embodiment of the present invention, there is provided a server cluster for providing 
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high availability of a service. The server cluster includes a first mass storage device located at a 
first site, a second mass storage device located at a second site, a first subcluster located at the 
first site, a second subcluster located at the second site, and a cluster manager. The first mass 
storage device includes at least one volume associated with the service. Similarly, the second 
mass storage device includes at least one volume associated with the service. The first subcluster 
includes a plurality of servers operably coupled to the first mass storage device. Moreover, the 
second subcluster includes at least one server operably coupled to the second mass storage 
device. The cluster manager is operable to allocate the service and the at least one volume of the 
first mass storage device to first server of the first subcluster, and mirror the at least one volume 
of the first mass storage device to the at least one volume of the second mass storage device. 
"Moreover, the computer readable medium includes instructions, which when executed, cause a 
cluster manager to determine to reallocate the service to a first Server of the second subcluster, 
allocate the first mirrored copy to the first server of the second subcluster, and allocate the 
service to the first server of the second subcluster in response to determining to reallocate the 
service to the first server of the second subcluster. " Carter, col. 2, lines 36-60 and col. 3, lines 8- 
16). 

In referring to claim 20, although Carter in view of Sicola shows substantial features of the 
claimed invention including the method of checking for failure in a cluster computing system, 
Carter in view of Sicola does not explicitly show de-installing a remote mirror. Nonetheless this 
feature is well known in the art and would have been an obvious modification to the system 
disclosed by Carter in view of Sicola, Carter in view of Sicola discloses: "It should be 
appreciated by those skilled in the art that mirroring is a continuous process. Accordingly, even 
though the flowchart of FIG. 2 illustrates mirroring as a distinct step of the exemplary operation 
the mirror copy of the data resources stored on the second shared storage device 108B at site B is 
continuously being updated in order to reject the current state of the data resources as stored on 
the first shared storage device 108 A at site A. " Carter, col. 6, lines 4-12) The mirrored copy of 
the data is continually updated, but Carter is silent as to how a failure of the minor is handled. 
However, Carter in view of Sicola discloses that when the first subcluster fails or is unavailable, 
the resources are reallocated to the subcluster with the mirrored volume. Once the mirrored 
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volume no longer exists (i.e. it becomes the primary volume), a new mirror is created. Given 
these teachings, a person of ordinary skill in the art would have readily recognized the 
desirability and advantages of modifying the system of Carter in view of Sicola so as to de-install 
the failed mirror, and create a new mirror, as shown by the operation of the primary subcluster. 

In referring to claim 21 , Carter in view of Sicola shows, 

Sending heartbeat messages to the production site host if said production host is enabled 1 , 
sending heartbeat messages to the standby site host if said standby host is enabled: "W server 
1 16A, 1 16B, ... 116Z may be unavailable to provide the database service for many reasons such 
as a hardware failure of the server, a software failure of the server, a power failure of the site at 
which the server is located, and/or a network failure preventing clients 102 A, 102B, 102Z access 
to the server. In an exemplary embodiment, the cluster manager determines whether a server 
116A, 116B, ... 116Z of the current subcluster 112A, 112B, ... 112Z is available based upon 
heartbeat signals transmitted amongst the servers 116A, 1 16B, ... 1 16Z of the server cluster 106. 11 
Carter, col. 6, lines 29-39) 

In referring to claim 22, Carter in view of Sicola shows, 

Checking for heartbeat messages from the production site host or the standby site host if the 
network is enabled, if an invalid heartbeat is received along the network and along the remote 
mirror, enabling the standby host to manage operations of the cluster computing system: 
"Moreover, the cluster manager is operable to determine to reallocate the service to a first server 
of the second subcluster, allocate the at least one volume of the second mass storage device to a 
first server of the second subcluster, and allocate the service to the first server of the second 
subcluster in response to determining to reallocate the service to the first server of the second 
subcluster. " (Carter, col. 2, lines 53-60) Carter, col. 6, lines 29-39 (See full quote above) 
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Conclusion 

The prior made of record and not relied upon is considered pertinent to applicant's disclosure. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Yasin Barqadle whose telephone number is 571-272-3947. The 
examiner can normally be reached on 9:00 AM to 5:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Glenn Burgess can be reached on 571-272-3949. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-872-9306 for regular 
communications and 703-746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-3900. 

Information regarding the status of an application may be obtained form the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either private PAIR or public PAIR system. Status information for 
unpublished applications is available through private PAIR only. For more information about the 
PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
YB 
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